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ABSTRACT 
This paper describes a decision-aiding tool embedded 
within a man-machine interactive system. It is an 
attempt to augment and sharpen man's judgment in 
evaluating proposed designs or plans of actions in 
terms of their possible consequences (desirable and 


undesirable). 


Man's judgment of alternative plans typically becomes 
less reliable when multiple criteria of varying impor- 
tance must be simultaneously considered. The difficulty © 
increases when different value orientations must be 

taken into account and somehow must be settled in group 


decision-making that affects many segments of our society. 


Techniques derived from the "fuzzy-set" concept, which 
allow systematic and explicit treatment of fuzziness (a 
type of impreciseness), are employed to guide the users 
during the evaluative process. The interactive tech- 
niques provide immediate feedback and ease of adjusting 
criteria for exploring complex trade-off possibilities. 
Users will be able to examine a much larger number of 
alternatives, weighing many different factors, than 
they normally might before a final decision has to be 
made. In addition, systematic techniques for direct 
involvement of people (experts as well as those repre- 


senting a variety of value systems) are also possible. 
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MACHINE-AIDED VALUE JUDGMENTS USING FUZZY-SET TECHNIQUES 


INTRODUCTION 

The major concern in this paper is how to evaluate programs with value-laden 
issues such as those that are directed toward improving the "quality of life"-- 
any programs, in fact, having socioeconomic, ecological, political, or psy- 
chological implications. We all know that technology has given us mixed 
blessings and that we are paying a high price for some of the "benefits" 
gained. Because technology often intermeshes intimately with the social 
fabric, we are becoming more and more aware of the necessity for long-range 
planning and for assessing possible consequences of our actions. It is in 

this planning and problem-solving context that I am going to discuss a 


technique of evaluation. 


To place the evaluative process in a proper setting, I shall first present 
a simple characterization of the four decision steps commonly found in problem 


solving. They are: 


Define the objectives and set appropriate criteria. 
Generate alternative courses of action. 
Identify or estimate possible consequences of each Sesaative. 
. Evaluate the consequences in terms of the criteria and choose the 


alternative which best achieves the objectives. 


Since the initial attempt at defining objectives and criteria is often 
inadequate and incomplete, these steps are usually repeated. The iterative 


nature of the process is shown schematically in Figure l. 
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‘ Problem environment 


and problem solvers 
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and 
Evaluate objectives 
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Figure 1. Iterative Decision Steps 


The man-machine system, Gaku, which is currently being developed deals with 
these steps in detail and in many levels of planning, from a vague and ag- 
gregated conceptual stage to a concrete and detailed action-oriented stage 
(see Hormann [1971], Part I and II). With this background, let us assume 
that many alternatives have been generated and their Aeuadpie consequences 


estimated and focus our attention on the evaluation phase of planning. 
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Difficulty in evaluating alternatives. Problem situations that are complex 
and ill defined often defy conventional cost/benefit analyses in evaluating 


alternative courses of action. 


. in matters affecting society, criteria for evaluation of both 
"costs" and “benefits'" are usually expressed in terms of “undesirable 
consequences" and "desirable consequences" and they are seldom well 


defined, much less quantified. 


. Even if they are made explicit and quantified, a single "quantitative 
measure of effectiveness' is seldom adequate to summarize the issues 


that arise because of the variety of impacts. 


. Differences in individual value orientation cause both obvious and 
subtle divergences in judgmental decision. Furthermore, such value . 
systems do change over time and in different contexts, even for the 


same individual. 


. Trade-off implications are complex and confusing even to an experienced 
decision maker because of the many attributes and their incommensurable 
values. Intuitive judgment is seldom reliable in such a situation. 
When the complexity of the situation exceeds the capacity of man to 
cope with it, oversimplification seh breSaveaee conclusion often result 


(see reference to "cognitive economy" in Hormann [1971], part I). 
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The approach taken and the rationale. My approach to this fuzzy evaluation 


task is to use Gaku, the man-machine interactive system, which includes a set 
of techniques and programs as a tool incorporating the ifugeeweet" concept 
(Zadeh [1965]). Use of this tool is the major topic of the discussion. A 
description of the "fuzzy-set" eoneene tat be given later; its meaning 
suggested by ieé name with BE sufficient now to permit one to understand the 


rationale behind our approach. 


. Although the value-laden issues will never be "solved," i.e., complete 
agreement on all the issues or universal acceptance of proposed pro- 
grams is not possible, the problems are here today and must be dealt 
with. We must act on the information available with techniques avail- 
able now and do the best we can. The approach proposed here is an 
attempt to assist man to evaluate systematically and judiciously where 
purely analytical or purely ieutetes methods are inadequate. However, 
we must adjust as we proceed and remain open to new ideas and 


techniques. 


. Man-machine interactive facilities and techniques can provide immediate 
feedback and a flexible means of adjusting criteria for evaluation. 
Man will be able to examine a much larger number of alternatives, 
weighing many different factors, than he normally can before a final 


decision has to be made. 
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Man's judgment of alternatives typically becomes less reliable when 
multiple criteria of varying importance must be simultaneously 
considered. The machine can "evaluate" many alternatives rapidly once 
criteria for evaluation are precisely specified. In the man-machine 
context, man is the specifier of criteria, which he can change as he 
makes different interpretations of objectives and as he examines trade- 
off implications in the light of new findings. Immediate feedback and 
the ease of adjusting his previous evaluation will encourage him to 


explore effects of changing values on criteria settings. 


‘ Systematic analyses of the situation supplemented by intuitive judgment 
is emphasized. The procedure presented here attempts to achieve 
consistency and comparability by explicit treatment of indeterminacy. 
(These points will be discussed later.) Systematic methods, such as 
the Delphi technique, for the direct involvement of experts as well as 
those representing a variety of value systems will also fit naturally 


into the man-machine setting. 


. This approach allows inclusion of many criteria in various degrees of 
imprecision and at differing levels of abstraction. It may be far more 
serious to omit a criterion that is believed to be iipenbent just 
because it cannot be made precise, than to include it at a low level 


of accuracy. 
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DESCRIPTION OF EVALUATION PROCESS 

Many areas of application are in sight and I can talk about the technique in 
completely general terms, but an example aay help to make the sontent a little 
more clear. Suppose a evaup oe commissioners (evaluators) are evaluating a 
number of proposed plans for developing a park (local, state, or national). 
There are dian criteria for determining the desirability of such plans, but 
let us say that "peaceful atmosphere" and "utility to the public" are the two 
important ones. Since these are very general, such criteria are usually 


described in terms of component attributes such as "number of acres of 


te ont tr ont 


vegetation or foliage," "number of feet or miles of streams, variety of 


flowers," for the first one; and other attributes such as "number of picnic 


" "number and sizes of parking lots," for the 


tables," "number of benches, 
second one. The latter group is relatively easy to evaluate for appropriateness 
since a set of "standard" numbers (per acre of park) is known. But the general 


criterion of "peaceful atmosphere" is much harder to represent since the total 


effect cannot be perceived readily from the components of the first group. 


Scale models of proposed plans are often useful for visual overall evaluation, 
but it would be prohibitively expensive and time consuming to provide models 


for all the alternative designs, Ay> Aos we A submitted. 
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One useful tool is a visual input/output display scope connected to a computer 


for man-machine interactive use.* 


Here, the terrain characteristics of the park-to-be area are displayed 
(preferably in color) to the group of evaluators and then a proposed design of 
the park is displayed with an option of enlarging any part of it for display.** 
Some verbal descriptions and numerical information such as cost and those 
attributes mentioned earlier (number of picnic tables, variety of planks “and 


flowers, etc.) can be added. 


Each evaluator is now asked to give his opinion of the design A, in relation 
to the criterion, "peaceful atmosphere." This is expressed as "grade of 
membership" (in the set of all alternatives for which the criterion applies) 
in terms of a number in the ieceeas [O, 1]. If the number is close to 1, say 


0.9, then A, has a high grade of membership as far as this attribute is con- 


i 


cerned; if it is close to 0, say 0.1, it is not a highly valued member. Since 


, | 
See INTUVAL (Kamnitzer and Hoffman [1970]). This work concerns interactive 
design in urban planning, but the same facility and the technique can be 
extended to assist evaluators who may not be professional designers. It may 
be desirable to have a mixed group of specialist-designers, government 
officials, representatives of diverse civic groups, etc., to avoid personal 
biases as much as possible. 


x | 
Ideally, each evaluator should be provided with an interactive facility. The 


evaluators work independently but can interact with each other through the 
system. | | 


To approach realism in evaluation, an existing park of similar size and 
purpose (if possible, one that nearly everyone likes) may be chosen. Photo- 
graphs of this actual park and a display of how it looks in abstraction will 
facilitate understanding of how a proposed park will be expected to look. 
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comparability is important in qualitative judgment, other alternative designs 


from A,, A, woe. AL can be displayed one or two at a time for comparison. The 


| Rodan 
evaluator can change his mind about the values he previously chose. The "grade 
of membership" he gives for the first design alternative he considers may be 


more or less arbitrary, but as he proceeds in the comparing process, the values 


tend to indicate the relative merits of the proposed designs. 


All evaluators in the group make their evaluations independently of each other, 
so the set of values collected may differ greatly. Group interaction with or 
without anonymity and reevaluation of the set of values can be the subsequent 
step, using the on-line or off-line Delphi technique* (more about this will be 
discussed later), or the evaluators can proceed to another attribute, still 
independently of each other. The only thing they must agree on first is the 
initial set of attributes. These can be changed later, but the group must 


agree on the changes. 


Fuzzy-set concept. I have tried to set a stage for an intuitive understanding 
of the "fuzzy-set" concept in the above discussion. Let us now clarify the 


notion of "grade of membership." Suppose X is the set of all alternatives. Let 


*See Dalkey [1969] and Helmer [1966]. The technique was initially used for 
soliciting and collating experts’ opinions in long-range forecasting, but many 
experiments have been conducted with members of the public for estimating 
desirability of certain programs, and understanding people's attitudes and 
value orientations. The major characteristics of the technique are anonymity, 
iteration and controlled feedback, and statistical group response. 
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A be a subset of X for which attribute a applies. In our park example, a may 
be "peaceful atmosphere." A person's subjective preference judgment can be 
represented by a preference relation which associates A. with a number in the 
interval [0, 1]. To this eelation: I have assigned the symbol R. The 


value R CAL) represents the "orade of membership" of A. in set A (see Figure 2).* 


ORG) RA) 1 


grades of membership 


Figure 2. Fuzzy-Set Association 


The two values, RY and R’ show a possible difference in two persons' judgments 
about A; on its grade of membership for attribute a. This tends to make more 


visible subtle individual differences in value orientation. 


* 

If an attribute can be defined in a non-fuzzy fashion for which a "yes" or 
"no" answer (1 or O value) can be given, then its membership function 
becomes identical with the characteristic function of a nonfuzzy set. 
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Trade-off considerations. One of the most important benefits we get from the 
use of this notion is that trade-off concepts can now be dealt with quanti- 
tatively. Suppose in our example of the park design, "utility to the public" 
has also been graded for each alternative. One factor of utility to the 
public may be "accessibility to many parts of the park by car." But many 
people feel strongly that this requirement will be in conflict with "peaceful 
atmosphere." It is true, but exclusive concentration on "peaceful atmosphere" 
and little accessibility will deprive some segments of the public (e.g., those 
who are infirm) from enjoying the total facility. Then, trade-off implications 
must be explored. Questions such as "How much 'peaceful atmosphere’ can be 
traded for how much 'public utility'?", which were meaningless in conventional 
evaluation, can now be treated sensibly because the two attributes are now 


comparable, represented by the same unit of measurement (see Figure 3). 


Even if all attributes were quantified (e.g., number of picnic tables, number 
of flowering plants, etc.), they are still incommensurable and the trade-off 
concept does not apply. It is, therefore, important to evaluate grades of 
membership for all the attributes, even though Some attributes are naturally 
quantifiable, such as "cost of developing the park" and "cost of maintenance." 


Here, costs are still evaluated on a comparative basis. 


The essence of this approach can be stated as follows: If it is inappropriate 
to quantify everything and reduce the measures to one single "measure of 


effectiveness", then change everything into value-oriented judgment. 
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Figure 3 shows the comparability of alternatives and attributes* 


ee) aes in 
a a ee 


0,5 0.5 0.4 
Alternative A,: R (A)) ; a, = peaceful atmosphere 
Y aa A, = utility to the public 
nn [ne 1 
| 0.8 P , 0.7 a, = cost of development 
Alternative A.: R (A,) © 0 
2 a 2 | 7 a, = cost of maintenance 
0 
. A, Oy Ay Oy 
t 
@ 
e 
® 
es et 1 
; 0.7 0,8 
0.4 Q.4 
Alternative A: R (A ) l / 
n a~ n 0 
A,  O, A, Oy 
Figure 3. Trade-Off Comparison of Attributes and Alternatives 


oe Figure 3, costs are shown in their grades of membership as the "preference" 
measure. Therefore, the lower cost, which is usually preferred, is rated high 
(the longer vertical line), and the higher cost is rated low (the shorter 
vertical line); this may be counterintuitive. The evaluators may prefer to 
group together as "cost'' all the attributes that should be minimized (e.g., 
pollution and noise) and as "benefits" all the attributes that should be 
maximized. Then these two groups are displayed separately (side-by-side but 
grouped together) and new values, R, =1 - R,, will be used for "cost" attri- 
butes (then a high cost shows a high vertical line). 
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There can be interesting derivatives of this kind of exercise. As the | 
evaluators made trade-off studies, new insights may be gained into the issues 
at hand and new ideas on modifications or compromises may be proposed. The 
designer then may be consulted to check the feasibility and the cost of such 
changes. Or, the insight may be in the recognition that new attributes should 


be added: old ones deleted, expanded, subdivided, or several combined into one. 


Even after all the attributes have been considered for all the alternatives, 
those values and vertical lines, though comparable, do not constitute the 


making of an overall judgment. One way to facilitate it is to calculate the 
| m 
summation S, = & Ws RY (A;) of all the weighted “grade of membership" 
i=1 i 
values over m attributes for each alternative.* Now comparing the summations 


is a meaningful operation and can be done by the computer very rapdily.** 


These = are called summary values. 


* Ws is a weighting specification to represent the relative importance of ©, 
(ranking of attributes and weighting will be discussed later). * 


** This form of getting a single value for each alternative is not the only 


way. Some nonlinear or nonuniform ways may be used to account for different 
contributions of attributes. 
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